Ndila et al. BMC Medicine 2014, 12:65 
http://www.bionnedcentral.conn/1 741 -701 5/1 2/65 



30 



Medicine for Global Health 



^BMC 



RESEARCH ARTICLE 



BMC Medicine 



Open Access 



Verbal autopsy as a tool for identifying children 
dying of sickle cell disease: a validation study 
conducted in Kilifi district, Kenya 



Carolyne Ndila^'^", Evasius Bauni''^ Vysaul Nyirongo^ George Mochamah', Alex Makazi', Patrick Kosgei', 



;1,2 



Gideon Nyutu', Alex Macharia', Sailoki Kapesa', Peter Byass^'"^'^ and Thomas N Williams 



-1,2,6 



Abstract 

Background: Sickle cell disease (SCD) is common in many parts of sub-Saharan Africa (SSA), where it is associated 
with high early mortality. In the absence of newborn screening, most deaths among children with SCD go 
unrecognized and unrecorded. As a result, SCD does not receive the attention it deserves as a leading cause of 
death among children in SSA. In the current study, we explored the potential utility of verbal autopsy (VA) as a tool 
for attributing underlying cause of death (COD) in children to SCD. 

Methods: We used the 2007 WHO Sample Vital Registration with Verbal Autopsy (SAVVY) VA tool to determine 
COD among child residents of the Kilifi Health and Demographic Surveillance System (KHDSS), Kenya, who died 
between January 2008 and April 201 1. VAs were coded both by physician review (physician coded verbal autopsy, 
PCVA) using COD categories based on the WHO International Classification of Diseases 10^^ Edition (ICD-10) and by 
using the lnterVA-4 probabilistic model after extracting data according to the 2012 WHO VA standard. Both of these 
methods were validated against one of two gold standards: hospital ICD-10 physician-assigned COD for children 
who died in Kilifi District Hospital (KDH) and, where available, laboratory confirmed SCD status for those who died 
in the community. 

Results: Overall, 6% and 5% of deaths were attributed to SCD on the basis of PCVA and the lnterVA-4 model, 
respectively. Of the total deaths, 22% occurred in hospital, where the agreement coefficient (ACi) for SCD between 
PCVA and hospital physician diagnosis was 95.5%, and agreement between lnterVA-4 and hospital physician diagnosis 
was 96.9%. Confirmatory laboratory evidence of SCD status was available for 1 5% of deaths, in which the ACi against 
PCVA was 87.5%. 

Conclusions: Other recent studies and provisional data from this study, outlining the importance of SCD as a cause of 
death in children in many parts of the developing world, contributed to the inclusion of specific SCD questions in 
the 201 2 version of the WHO VA instruments, and a specific code for SCD has now been included in the WHO and 
lnterVA-4 COD listings. With these modifications, VA may provide a useful approach to quantifying the contribution 
of SCD to childhood mortality in rural African communities. Further studies will be needed to evaluate the 
generalizability of our findings beyond our local context. 
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Background 

Sickle cell disease (SCD) [1,2] represents a growing health 
problem both in Africa and in populations of African ori- 
gin [3]. In a recent study, we estimated that, currently, 
more than 300,000 children are born with SCD worldwide 
every year [3]. Approximately three-quarters of these 
births occur in sub-Saharan Africa (SSA), where facilities 
for the diagnosis and treatment of SCD are few. As a 
result, between 50 and 90% of children born with SCD on 
the continent die undiagnosed in the first 5 years of life 
[4]. The combination of these high birth rate and mortal- 
ity figures mean that SCD currently accounts for more 
than 6% of all deaths among children younger than 5 years 
in SSA [5]. 

Poor awareness of SCD among health leaders, com- 
bined with a lack of facilities for proper diagnosis and 
care, means that few data are available regarding such 
basic questions as the modes and age profile of deaths 
among children with SCD throughout much of SSA. 
Recognizing this knowledge gap, we investigated whether 
verbal autopsy (VA), in which a structured questionnaire 
is administered to the relatives of deceased people, with a 
view to ascertaining the probable causes of death, might 
be one potential approach to investigating the contribu- 
tion of SCD to childhood deaths in areas where facilities 
for diagnosis are suboptimal. Here we present data from a 
study in which we investigated the utility of VA as a tool 
for diagnosing SCD among children dying in Kilifi County 
on the coast of Kenya. 

Methods 

Ethics approval 

Ethics permission was granted by the KEMRI/National 
Ethics Review Committee (ERC) in Nairobi and VAs were 
only administered after obtaining written informed consent 
from potential respondents. 

Study area 

The study was conducted within the area served by 
the Kilifi Health and Demographic Surveillance System 
(KHDSS) on the coast of Kenya [6]. Established in October 
2000, the KHDSS serves as a framework for population- 
based epidemiological studies of diseases of local import- 
ance, monitors mortality trends, and is used to test and 
evaluate the impact of public health interventions. The 
KHDSS covers an area of 891 km^ and includes a resident 
population that currently numbers approximately 260,000. 
Between 1,200 and 1,500 deaths are recorded each year, of 
which 240 to 300 are among children older than 28 days 
and younger than 14 years of age. More than 60% of these 
deaths occur outside hospital, and their causes are rarely 
recorded. 

Kilifi District Hospital (KDH) provides primary care 
for the residents of the KHDSS, serving a population of 



approximately 125,000 children younger than 14 years, and 
acting as a first-referral hospital for healthcare facilities 
throughout Kilifi District [7]. The KHDSS forms one com- 
ponent of an integrated health surveillance system: resi- 
dents of the area are identified at the point of admission 
to KDH, where their clinical data are immediately entered 
onto a computerized database, along with the results of a 
range of routine laboratory investigations [6]. KDH is the 
only health facility in Kilifi District that provides specialist 
care to children with SCD. 

Study population and cause of death assignment using 
verbal autopsy 

In collaboration with the Kenyan Ministry of Health 
(MOH), the KHDSS began collecting VA data in 2008 
with the aim of documenting the pattern of underlying 
cause of death (COD) in the community [8]. The current 
analysis focuses on residents of the KHDSS area aged 
28 days to 14 years who died between January 2008 and 
April 2011. VAs were administered for these children 
using the standard 2007 WHO Sample Vital Registration 
with Verbal Autopsy instrument [8]. VAs were reviewed 
and coded to provide a maximum of two underlying 
CODs by two separate methods. First, we used conven- 
tional physician coded verbal autopsy (PCVA) in which 
two independent clinicians reviewed each questionnaire 
and indicated the underlying COD. As described previously 
[8], to facilitate comparisons between COD assignment by 
PCVA and COD assignment by physicians on the hospital 
wards, the PCVA coding in the current study followed 
the longer COD list described in the WHO Inter- 
national Classification of Diseases and Related Health 
Problems 10th revision (ICD-10) [9] rather than the 
more restricted list that is normally used with the 
WHO 2007 instruments. Importantly, for the purposes 
of the current study, unlike the restricted WHO 2007 
COD list, the ICD-10 list included a code for SCD. 
Where the two clinicians disagreed or where one could 
not make a diagnosis, a third clinician was consulted. A 
COD was assigned when two clinicians agreed on the 
COD. In instances where there was no agreement 
between the three clinicians, a consensus COD was 
reached through arbitration. None of the clinicians had 
access to data regarding the name or SCD status 
(affected or unaffected) of deceased and no predeter- 
mined diagnostic algorithms were used to attribute 
CODs to SCD. For the purpose of this analysis, assess- 
ments were specifically categorized according to 
whether or not SCD was mentioned among the under- 
lying CODs. Second, we also used the freely available 
InterVA-4 computer-based probabiUstic model [10] to 
assign CODs. The 2012 WHO SCD indicator did not 
map directly to any specific question contained in 
our questionnaires, which were based on the 2007 
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WHO instrument. However, these data were partially 
captured in the free-text sections of the VA forms, for 
which we developed an automated search for 'sickle OR 
scd' and mapped it onto the SCD indicator. 

COD assignment in the pediatric ward at KDH 

High-quality clinical and laboratory data were available 
for a subset of children who died in KDH [8]. In order 
to facilitate comparisons between these different methods 
of COD assignment, we mapped the ICD-10 COD codes 
generated by both PCVA and by the hospital physicians 
to conform to the 2012 WHO VA COD categories that 
are used by the InterVA-4 software [11] (see Additional 
file 1). 

Confirmatory laboratory evidence for SCD 

Worldwide, a number of genotypes manifest phenotypically 
as SCD. The principal genotypes include homozygosity 
for the mutation of the HBB gene (HbSS), sickle cell- 
hemoglobin C disease (HbSC) and sickle cell-|3-thalassemia. 
HbSS is the only significant cause of SCD in Kenya [12]. 
Results of blood tests for HbS typing, conducted by ei- 
ther cellulose acetate hemoglobin electrophoresis (Helena 
Laboratories, Beaumont, TX, USA) or by high perform- 
ance liquid chromatography (Variant Analyzer, BioRad, 
Hercules, CA, USA), were available for a subset of chil- 
dren who were either tested during the course of their ad- 
mission to KDH or who were members of two prospective 
cohort studies: (i) the Kilifi Sickle Cell Disease (KSCD) 
study [13] or the Kilifi Genetic Birth Cohort (KGBC) 
study [14]. We quantified the contribution of SCD to 
childhood mortality according to VA, and validated the 
results in the subset of deaths in children who had been 
involved in any of these studies, and for whom there 
was therefore laboratory data that confirmed or refuted 
a diagnosis of SCD HbSS. 

Data handling 

First, we compared data on the underlying CODs recorded 
by the two VA clinicians to determine inter-reviewer agree- 
ment. Second, we compared the underlying CODs reached 
by PCVA consensus against the InterVA-4 model. Third, 
for those who had died in KDH, we validated the CODs 
assigned by PCVA and the InterVA-4.02 model against 
the COD recorded through the KDH pediatric ward 
surveillance system. Where more than one COD was 
given, we selected the underlying COD as our unit of 
comparison between the VA and pediatric ward COD. 
Finally, we validated the VA CODs in the subset of deaths 
with available laboratory data. 

Statistical analysis 

We used the agreement coefficient of Gwet (ACi) [15,16] 
to measure levels of agreement (see Additional file 2). 



Sensitivity and specificity were also calculated to measure 
diagnostic validity of the VA tool and InterVA-4 model in 
identifying deaths due to SCD. 

Data were transformed using SAS® v.9.2 (SAS Institute 
Inc., Cary, NC, USA) software and all analyses carried 
out using RvS.O.O [17]. 

Results 

Total deaths recorded and VAs administered 

During the period of the study, a total of 750 deaths 
among children aged between 28 days and 14 years were 
recorded through the KHDSS. VAs were administered 
and PCVA and InterVA-4.02 applied to 610 (81.3%) of 
these deaths. VAs were omitted for the following rea- 
sons: movement of the family from the study area (86; 
11.5%), no appropriate respondent identified (30; 4.0%) 
and refusal of relatives to be interviewed (8; 1.1%). No 
reason was given for 16 (2.1%). Of those with com- 
pleted VAs, the median age at death was 2.0 years; 452 
(74%) were children aged under 5 years, of whom 262 
(58%) were infants. Of the 610 children, 334 (55%) 
were male. Regarding place of death, 45% of children 
died in their homes, 43% died in hospital and 12% died 
elsewhere. 

Agreement between PCVA coders 

The cause-specific mortality fractions (CSMFs) assigned 
by the two primary PCVA coders are summarized in 
Figure 1 and Additional file 3. The most common diagno- 
ses assigned by both clinicians were malaria, malnutrition, 
bacterial meningitis, pneumonia, congenital malformations, 
and SCD. Agreement between the two PCVA coders varied 
by diagnosis. For example, PCVA coder 1 attributed 84 
(14%) and 33 (5%) of the total 610 deaths to malaria and 
HIV respectively, whereas PCVA coder 2 attributed 96 
(16%) deaths to malaria and 21 (3%) to HIV. In addition, 
PCVA coder 1 attributed 65 (11%) deaths to malnutri- 
tion, while PCVA coder 2 attributed only 34 (6%). The 
overall inter-coder agreement (ACi) for all deaths was 
54.6% (Table 1), corresponding only to a moderate to 
high level of agreement [15]. Conversely, however, the 
ACi for deaths due to SCD was very high [15], at 97.3% 
(Table 1). Coders did not include SCD in their list of 
underlying causes of death on the basis of any fixed 
algorithms, but treated each VA on a case-by-case basis. 
In some cases, SCD was included under questions 511 
and 512, which enquired about pre-existing conditions, 
in others, the coders appeared to have formed their view 
on the basis of the free-text elements at the end of the 
form, which sometimes described characteristic features 
of SCD, or on the basis of specific responses to ques- 
tions within the form. Two such questions that ap- 
peared to have particular influence were questions 869 
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Figure 1 Cause-specific mortality fractions (CSMFs) for 610 child deaths interpreted by verbal autopsy (VA) coders. CSMFs for 610 
deaths of children aged less than 14 years in the Kilifi Health and Demographic Surveillance System (KHDSS) study area, derived from verbal 
autopsies interpreted by two independent physician coders. 



and 870, relating to the presence and duration of jaundice, 
respectively. 



information contained within the free-text section of the 
questionnaires. 



Agreement between PCVA consensus and the 
lnterVA-4 model 

The CSMFs assigned by PCVA and by the InterVA-4 
model are summarized in Figure 2 and Additional file 3. 
The InterVA-4 model assigned more deaths (13%) to 
HIV than did PCVA (5%), whereas PCVA attributed 8% 
of deaths to malnutrition, while the InterVA-4 model 
attributed only 3%. CSMFs obtained between the InterVA- 
4 model and PCVA were within ±2% for the other diagno- 
ses, as shown in Figure 2 and Additional file 3. The ACi 
for all deaths was 50.6%, while the ACi for deaths due to 
SCD was very high, at 94.6% (Table 1). We noted that the 
assignment of SCD as the underlying COD both by PCVA 
and by the InterVA-4 model was strongly influenced by 



Agreement between CODs determined by PCVA, the 
lnterVA-4 model, and by clinicians on the KDH 
pediatric ward 

COD was available from the pediatric ward for 134/610 
(22%) of children with VA data, for whom we were able 
to compare data regarding the underlying CODs assigned 
by the attending clinicians with that assigned both 
by PCVA and by the InterVA-4 model (Figure 3; see 
Additional file 3). The CSMFs obtained between PCVA 
and the InterVA-4 model against the KDH pediatric ward 
COD were within ±2% for SCD, meningitis, congenital 
malformation, and diarrheal diseases. PCVA and the 
InterVA-4 model attributed 13% and 5% of deaths 
to pneumonia respectively, while 19% of deaths were 



Table 1 Agreement between the four validation methods In determining the causes of children's deaths 



Methods 



ACi for all CODs, % (SE) (95% CI) 



ACi for COD due to SCD, % (SE) (95% CI) 



PCVA coder 1 versus PCVA coder 2 (n = 610) 


54.6 (2.0) 


(50.7 to 


58.5) 


97.4 (0.6) 


(95.9 to 


98.7) 


lnterVA-4 model versus PCVA consensus (n = 610) 


50.6 (5.0) 


(48.7 to 


57.2) 


94.6 (0.9) 


(95.0 to 


99.0) 


lnterVA-4 model versus paediatric ward COD (n = 134) 


42.5 (3.6) 


(35.4.0 to 49.6) 


96.9 (1.5) 


(95.0 to 


99.0) 


PCVA consensus versus pediatric ward COD (n = 134) 


50.0 (5.1) 


(40.0 to 


60.0) 


95.5 (1.8) 


(92.0 to 


99.0) 


PCVA consensus versus laboratory evidence (n = 93) 








87.5 (4.4) 


(78.9 to 


96.1.) 



ACi, Agreement coefficient of Gwet; CI, confidence interval; COD, cause of death; SCD, sickle cell disease. SE, Standard error; VA, verbal autopsy. 
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Figure 2 Cause-specific mortality fractions (CSMFs) for 610 child deaths interpreted by physician coded verbal autopsy (PCVA) and the 
lnterVA-4 model. CSMFs for 610 deaths of children aged less than 14 years in the Kilifi Health and Demographic Surveillance System (KHDSS) 
study area, derived from verbal autopsies interpreted by PCVA and the lnterVA-4 model. 



attributed to pneumonia on the pediatric ward. Similarly, 
PCVA and the InterVA-4 model assigned almost twice 
as many deaths to malaria as did clinicians on the 
pediatric ward. The InterVA-4 model attributed 12% of 
deaths to HIV/AIDS, whereas the PCVA and the 



pediatric ward clinicians attributed 5% and 6% of deaths 
respectively. By contrast, the InterVA-4 model attrib- 
uted 2% of deaths to malnutrition, while both the 
PCVA and the pediatric ward clinicians attributed 13%. 
The InterVA-4 model, PCVA, and pediatric ward 
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Figure 3 Cause-specific mortality fractions (CSMFs) for 134 child deaths assigned by physician coded verbal autopsy (PCVA), the lnterVA-4 
model and pediatric hospital cause of death (COD). The figure shows CSMFs for 134 child deaths. Underlying CODs determined by PCVA and the 
lnterVA-4 model were compared against the COD given by physicians for those who died on the pediatric ward at Kilifi District Hospital (KDH). 
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clinicians attributed 5%, 6% and 5% of deaths, respect- 
ively, to SCD. 

Validation of VA against gold standards 

Overall, the ACi between CODs ascribed by PCVA con- 
sensus and those assigned by physicians on the pediatric 
ward was 50.0%, defined as only a moderate to high level 
of agreement. Similarly, the ACi between the CODs 
assigned by the InterVA-4 model and those assigned on 
the pediatric ward was only 42.5% (Table 1). However, 
the ACi with regard to the specific diagnosis of SCD 
was 95.5% and 96.9%, respectively, for physician coded 
VA and the InterVA-4 model (Table 1), consistent with a 
very high level of agreement. Although physicians on the 
pediatric ward did not include SCD as one of their 
underlying CODs on the basis of any fixed diagnostic 
algorithms, they had the considerable advantage over the 
PCVA and Inter VA-4 methods of being able to take a 
detailed clinical history, perform a clinical examination, 
and access specialist tests. In a number of cases, patients 
were already known attenders at a SCD clinic, and were 
taking regular prophylaxis for malaria and bacterial dis- 
eases. In other cases, patients had a characteristic feature 
of SCD within their previous medical history, such as a 
previous admission to hospital in infancy with swollen 
hands and feet, recurrent admission to hospital with pain 
in the arms or legs, or frequent admission to hospital with 
anemia requiring transfusion. In a further group of 
children, the clinicians' suspicions appear to have been 
aroused by findings on clinical examination such as 
jaundice or splenomegaly, or through observation of 
the characteristic facial features of SCD. In addition, 
clinicians had access to data on full blood counts and 
the ability to confirm their clinical suspicion by blood 
film examination and electrophoresis. Taking the pediatric 
ward COD as the gold standard for these reasons, the ob- 
served sensitivities and specificities for both the PCVA 
and InterVA-4 methods across the top 10 major CODs 
are presented in Table 2. The sensitivity with regard to the 
diagnosis of SCD was 83% in the case of both PCVA and 
of VAs interpreted using InterVA-4, while the specificity 
was 98% and 99%, respectively. 

Agreement between PCVA consensus and confirmatory 
laboratory evidence 

To further assess the validity of the VA tool with regard 
to the identification of deaths attributable to SCD, we 
also reviewed the COD data determined by VA in the 
subset of 93 children (15% of 610) for whom laboratory 
evidence regarding SCD status was available. Of these, 
62 (67%) children were phenotype HbAA (normal), 11 
(12%) were HbAS (heterozygous carriers) and 20 (21%) 
were HbSS (that is, they had SCD). The SCD-specific ACi 
between COD by PCVA and the laboratory phenotype 



was 87.5% (Table 1). Taking the laboratory data as the gold 
standard, the sensitivity and specificity of COD according 
to PCVA for a diagnosis of SCD were 76.9% and 96.6%, 
respectively. 

Discussion 

Although common, SCD remains neglected in many parts 
of SSA [18]. Few countries have programs for the early 
diagnosis or specialist treatment of SCD, and the majority 
of those affected therefore continue to die undiagnosed 
during early childhood [4]. Although infections, including 
bacterial diseases [19] and malaria [7,20,21], are widely 
regarded as probable causes of this early mortality, to a 
large extent the natural history of SCD in African pop- 
ulations remains poorly documented [18]. 

In this study, we investigated the question of whether 
VA might prove a useful approach to the identification of 
deaths due to SCD in populations for which more robust 
data on COD are not available. If VA does prove reliable 
then it could provide a useful tool for improving knowledge 
on the epidemiology of SCD in resource-poor settings, 
which could also be helpful both for advocacy and for 
public health planning. 

Consistent with previous studies [22-28], we found 
that PCVA performed better for some diagnoses than 
for others. A single previous study was conducted in the 
same population, which aimed to validate VA against 
COD data from the hospital wards [25]. In that study, 
VA was associated with the following sensitivities, speci- 
ficities and positive predictive values with regard to the 
attribution of CODs in children older than 1 month, 
which were broadly similar to those in the current study: 
acute respiratory infection 28%, 91%, and 29%, respect- 
ively; meningitis 38%, 94%, and 20%; and malnutrition 
89%, 96%, and 87%. Conversely, the sensitivity of VA for 
the attribution of malaria was somewhat higher in the 
current (83%) than in the previous study (46%), although 
specificity and positive predictive values were similar in 
both (90% versus 89% and 50% versus 57%, respectively). 
Measles, a common COD in the earlier study, did not 
feature among the top 10 diagnoses in the current study, 
whereas HIV did. Some of these differences might be ex- 
plained by changes that have been made to the VA tools 
since the earlier study was conducted, but there have 
also been significant changes in the patterns of morbidity 
and mortality in the community in the intervening period. 
Malaria, previously the single most common cause of ad- 
mission and death at KDH, has declined significantly in 
recent years [29], universal childhood vaccination against 
measles has been introduced, and the HIV epidemic has 
become well established. 

The main focus of the current manuscript, however, 
is SCD. We found that COD attribution by VA for 
this diagnosis was consistently good from a number of 
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Table 2 Validation results for the lnterVA-4 model and PCVA consensus against the pediatric ward COD for the top ten 
CODs among 134 child deaths 



C3US6 of cl6dth 


Sensitivity, % 


Specificity, % 


PPV% 




NPV% 






lnterVA-4 


PG/A consensus lnterVA-4 


PCVA consensus 


lnterVA-4 


PCVA consensus 


lnterVA-4 


PCVA consensus 


1.05: Malaria 


80 


83 


83 


90 


38 


50 


97 


97 


1.02: Pneumonia 


14 


28 


94 


91 


14 


41 


81 


85 


3.02: Severe malnutrition 


10 


47 


97 


91 


10 


44 


87 


92 


98: Other unspecified 
non-communicable disease 


9 


18 


100 


92 


100 


17 


92 


93 


1 0.06: Congenital malformation 


55 


73 


98 


98 


67 


73 


96 


98 


1.07: Meningitis 


12 


44 


91 


94 


15 


33 


93 


96 


1.03: HIV/AIDS 


40 


43 


88 


95 


18 


24 


94 


93 


1.04: Diarrheal diseases 


29 


29 


96 


98 


29 


40 


96 


96 


4.03: Sickle cell with crisis 


83 


83 


99 


98 


83 


63 


99 


99 



NPV, negative predicted value; PCVA, physician coded verbal autopsy; PPV, positive predictive value. 



perspectives. First, agreement between coders was consid- 
erably higher for SCD (973%) than for all other diagnoses 
combined (54.6%) (Table 1). Second, agreement between 
the InterVA-4 model and hospital COD was considerably 
higher for SCD (96.9%) than for other diagnoses com- 
bined (42.5%) (Table 1). Third, agreement between 
PCVA data and hospital COD was considerably higher 
for SCD (95.5%) than for other diagnoses combined 
(50%) (Table 1). Finally, agreement between VA coded 
data and laboratory-proven SCD was also high at 87.5% 
(Table 1). Moreover, the proportion of all deaths that were 
attributed to SCD by VA (6%) was in broad agreement 
with that predicted from other studies in Africa [5], and is 
also consistent with that we would predict within the Kilifi 
population. During the period covered by this study, over- 
all mortality among children aged 1 month to 15 years 
was in the region of 40/1000, while around 0.8% of all 
births are affected by SCD [19]. Assuming that 50% of 
these children die during the first 5 years of life, and that 
most of these deaths occur after the first month of life [4], 
SCD should account for around 10% of all deaths among 
children of this age. Taken together, therefore, these data 
suggest that the VA method can deliver a plausible esti- 
mate of the burden of SCD in our study population. 

It is noteworthy that SCD did not feature as a diagno- 
sis either in the previous validation study conducted in 
Kilifi [25] or in other similar studies [24,27]. The most 
likely explanation is that no specific code for SCD was 
included in the shortlist of codes used in these previous 
VA studies. This is certainly true for the Kilifi study, 
where deaths from SCD will most likely have been dis- 
tributed between the classifications 'anemia' and 'others'. 
Similarly, no specific code for SCD was included even in 
much larger validation studies such as those published 
by Setel and colleagues [30] or by Murray and colleagues 
[31]. Of note, in the latter study, the authors stated that 



their cause list was constructed based on the WHO Global 
Burden of Disease estimates of the leading causes of death, 
potential to identify unique signs and symptoms, and the 
likely existence of sufficient medical technology to ascertain 
gold standard cases. This is of particular concern be- 
cause it reflects the low visibility that SCD currently 
holds in the eyes of the international health community, 
despite accounting for rising proportion of declining 
deaths in children under 5 years of age. In the current 
study, we used the longer ICD-10 category list for our 
COD assignment by both PCVA and by hospital physi- 
cians, and the WHO 2012 cause Ust for our COD as- 
signment by InterVA-4. While it is obvious that the 
absence of a code for SCD in previous code lists will 
have led to a systematic underestimation of SCD as a 
COD (to the point of absence) in previous studies, we 
cannot exclude the possibility that the use of these lon- 
ger cause lists might have led to an overestimation of 
SCD as a COD in the current study; further work will 
be required to investigate this possibility in the future. 

During the current study we noted that no specific 
questions relating to SCD were included in the 2007 
WHO VA forms, and that the attribution of SCD as the 
underlying COD both by PCVA and by the InterVA-4 
model therefore leant heavily on the free-text element of 
the questionnaires. Increasing awareness of the import- 
ance of SCD as a major COD in the African context from 
a number of recent studies [4,5,19,32], and provisional 
data from this study has now led to the inclusion within 
the 2012 version of the WHO Verbal Autopsy Instrument 
of a specific question regarding SCD [11]. Similarly, a 
specific code for SCD has also now been included in 
the list of CODs formulated by WHO for VA use, and 
can also be assigned by the InterVA-4 model. The full 
process by which this decision, and the decision to 
introduce or to drop other specific CODs from the 
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2012 list, were made have been described recently by 
Leitao and colleagues [33]. 

Although our study provides new evidence that VA 
has potential as a tool for identifying deaths due to SCD, 
it is open to a number of criticisms. Perhaps most im- 
portantly, SCD constitutes a major research interest at 
our program [7,13,19,20] and, as a result, it is possible 
that our coding clinicians are unusually well versed in 
the signs and symptoms of SCD. We aimed to mitigate 
against this bias by applying the InterVA-4 model, which 
at least guarantees consistency and comparability with 
possible future studies elsewhere. Similarly, in order to 
validate our COD assignment by VA, we used as our 
gold standard COD assignment by a clinician for the 
subset of deaths that occurred in hospital. We cannot 
be sure that the distribution of CODs among deaths that 
occur in hospital is fully representative of CODs overall, 
and this could potentially lead to an unrecognized and 
unmeasurable bias. Nevertheless, we suggest that our 
study would benefit from replication and validation at 
other sites. 

We have previously estimated that approximately 240,000 
children are born with SCD annually in Africa alone [3] 
and that 50-90% of these children die undiagnosed in their 
first few years of life [4]. Others have estimated that this 
means that SCD accounts for around 6% of all child 
deaths in SSA [5], placing SCD firmly on the list of leading 
causes of death, at least in countries where the gene 
frequency is high. This is recognized by the welcome 
inclusion of the hemoglobinopathies in the latest round of 
the Global Burden of Disease Study [34]. Nevertheless, 
much more remains to be done to raise the profile of SCD 
on the global health agenda. 

Conclusion 

In summary, we have presented data suggesting that VA 
might provide a useful approach to investigating the 
contribution of SCD to childhood deaths in one part of 
SSA. We hope that our study will prompt similar work 
in other parts of Africa, including the further exploration 
of automated approaches to VA coding that might be 
generalized to other settings. 

Additional files 



Additional file 1: Spreadsheet showing mapping of physician 
coded verbal autopsy (PCVA) and hospital causes of death to the 
2012 WHO verbal autopsy (VA) cause of death (COD) categories. 

The spreadsheet shows how the PCVA and hospital causes of death were 
mapped to the 2012 WHO VA categories in order to facilitate 
comparisons between the three methods. 

Additional file 2: Calculation of the agreement coefficient of Gwet. 

Additional file 3: Cause-specific mortality fractions as assigned 
by the three different methods of cause of death (COD) 
assignment. 
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